A Common Framework for Natural Gradient and Taylor based Optimisation using Manifold Theory
نویسنده
چکیده
This technical report constructs a theoretical framework to relate standard Taylor approximation based optimisation methods with Natural Gradient (NG), a method which is Fisher efficient with probabilistic models. Such a framework will be shown to also provide mathematical justification to combine higher order methods with the method of NG.
منابع مشابه
A Semi-analytical Solution for Flexural Vibration of Micro Beams Based on the Strain Gradient Theory
In this paper, the flexural free vibrations of three dimensional micro beams are investigated based on strain gradient theory. The most general form of the strain gradient theory which contains five higher-order material constants has been applied to the micro beam to take the small-scale effects into account. Having considered the Euler-Bernoulli beam model, governing equations of motion are w...
متن کاملFree Vibration Analysis of Microtubules as Orthotropic Elastic Shells Using Stress and Strain Gradient Elasticity Theory
In this paper, vibration of the protein microtubule, one of the most important intracellular elements serving as one of the common components among nanotechnology, biotechnology and mechanics, is investigated using stress and strain gradient elasticity theory and orthotropic elastic shells model. Microtubules in the cell are influenced by internal and external stimulation and play a part in con...
متن کاملA Natural Gradient Algorithm for the Solution of Lyapunov Equations Based on the Geodesic Distance
A new framework based on the curved Riemannian manifold is proposed to calculate the numerical solution of the Lyapunov matrix equation by using a natural gradient descent algorithm and taking the geodesic distance as the objective function. Moreover, a gradient descent algorithm based on the classical Euclidean distance is provided to compare with this natural gradient descent algorithm. Furth...
متن کاملSoil and Rock Slope Stability Analysis based on Numerical Manifold Method and Graph Theory
Limit equilibrium method, strength reduction method and Finite Difference Methods are the most prevalently used methods for soil and rock slope stability analysis. However, it can be mention that those have some limitations in practical application. In the Limit equilibrium method, the constitutive model cannot be considered and many assumptions are needed between slices of soil and rock. The s...
متن کاملReduced order model for doubly output induction generator in wind park using integral manifold theory
A dynamic reduced order model using integral manifold theory has been derived, which can be used to simulate the DOIG wind turbine using a double-winding representation of the generator rotor. The model is suitable for use in transient stability programs that can be used to investigate large power systems. The behavior of a wind farm and the network under various system disturbances was stu...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2018